Dashboards in Health Care Settings: Protocol for a Scoping Review.

BACKGROUND: Health care organizations increasingly depend on business intelligence tools, including "dashboards," to capture, analyze, and present data on performance metrics. Ideally, dashboards allow users to quickly visualize actionable data to inform and optimize clinical and organizational performance. In reality, dashboards are typically embedded in complex health care organizations with massive data streams and end users with distinct needs. Thus, designing effective dashboards is a challenging task and theoretical underpinnings of health care dashboards are poorly characterized; even the concept of the dashboard remains ill-defined. Researchers, informaticists, clinical managers, and health care administrators will benefit from a clearer understanding of how dashboards have been developed, implemented, and evaluated, and how the design, end user, and context influence their uptake and effectiveness. OBJECTIVE: This scoping review first aims to survey the vast published literature of "dashboards" to describe where, why, and for whom they are used in health care settings, as well as how they are developed, implemented, and evaluated. Further, we will examine how dashboard design and content is informed by intended purpose and end users. METHODS: In July 2020, we searched MEDLINE, Embase, Web of Science, and the Cochrane Library for peer-reviewed literature using a targeted strategy developed with a research librarian and retrieved 5188 results. Following deduplication, 3306 studies were screened in duplicate for title and abstract. Any abstracts mentioning a health care dashboard were retrieved in full text and are undergoing duplicate review for eligibility. Articles will be included for data extraction and analysis if they describe the development, implementation, or evaluation of a dashboard that was successfully used in routine workflow. Articles will be excluded if they were published before 2015, the full text is unavailable, they are in a non-English language, or they describe dashboards used for public health tracking, in settings where direct patient care is not provided, or in undergraduate medical education. Any discrepancies in eligibility determination will be adjudicated by a third reviewer. We chose to focus on articles published after 2015 and those that describe dashboards that were successfully used in routine practice to identify the most recent and relevant literature to support future dashboard development in the rapidly evolving field of health care informatics. RESULTS: All articles have undergone dual review for title and abstract, with a total of 2019 articles mentioning use of a health care dashboard retrieved in full text for further review. We are currently reviewing all full-text articles in duplicate. We aim to publish findings by mid-2022. Findings will be reported following guidance from the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist. CONCLUSIONS: This scoping review will provide stakeholders with an overview of existing dashboard tools, highlighting the ways in which dashboards have been developed, implemented, and evaluated in different settings and for different end user groups, and identify potential research gaps. Findings will guide efforts to design and use dashboards in the health care sector more effectively. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/34894.

Adherence to Antiretroviral Therapy During and After Pregnancy: Cohort Study on Women Receiving Care in Malawi's Option B+ Program.

BACKGROUND: Adherence to antiretroviral therapy (ART) is crucial to preventing mother-to-child transmission of human immunodeficiency virus (HIV) and ensuring the long-term effectiveness of ART, yet data are sparse from African routine care programs on maternal adherence to triple ART. METHODS: We analyzed data from women who started ART at 13 large health facilities in Malawi between September 2011 and October 2013. We defined adherence as the percentage of days "covered" by pharmacy claims. Adherence of ≥90% was deemed adequate. We calculated inverse probability of censoring weights to adjust adherence estimates for informative censoring. We used descriptive statistics, survival analysis, and pooled logistic regression to compare adherence between pregnant and breastfeeding women eligible for ART under Option B+, and nonpregnant and nonbreastfeeding women who started ART with low CD4 cell counts or World Health Organization clinical stage 3/4 disease. RESULTS: Adherence was adequate for 73% of the women during pregnancy, for 66% in the first 3 months post partum, and for about 75% during months 4-21 post partum. About 70% of women who started ART during pregnancy and breastfeeding adhered adequately during the first 2 years of ART, but only about 30% of them had maintained adequate adherence at every visit. Risk factors for inadequate adherence included starting ART with an Option B+ indication, at a younger age, or at a district hospital or health center. CONCLUSIONS: One-third of women retained in the Option B+ program adhered inadequately during pregnancy and breastfeeding, especially soon after delivery. Effective interventions to improve adherence among women in this program should be implemented.

Retention in care during the first 3 years of antiretroviral therapy for women in Malawi's option B+ programme: an observational cohort study.

BACKGROUND: Studies of Malawi's option B+ programme for HIV-positive pregnant and breastfeeding women have reported high loss to follow-up during pregnancy and at the start of antiretroviral therapy (ART), but few data exist about retention during breastfeeding and after weaning. We examined loss to follow-up and retention in care in patients in the option B+ programme during their first 3 years on ART. METHODS: We analysed two data sources: aggregated facility-level data about patients in option B+ who started ART between Oct 1, 2011, and June 30, 2012, at 546 health facilities; and patient-level data from 20 large facilities with electronic medical record system for HIV-positive women who started ART between Sept 1, 2011, and Dec 31, 2013, under option B+ or because they had WHO clinical stages 3 or 4 disease or had CD4 counts of less than 350 cells per µL. We used facility-level data to calculate representative estimates of retention and loss to follow-up. We used patient-level data to study temporal trends in retention, timing of loss to follow-up, and predictors of no follow-up and loss to follow-up. We defined patients who were more than 60 days late for their first follow-up visit as having no follow-up and patients who were more than 60 days late for a subsequent visit as being lost to follow-up. We calculated proportions and cumulative probabilities of patients who had died, stopped ART, had no follow-up, were lost to follow-up, or were retained alive on ART for 36 months. We calculated odds ratios and hazard ratios to examine predictors of no follow-up and loss to follow-up. FINDINGS: Analysis of facility-level data about patients in option B+ who had not transferred to a different facility showed retention in care to be 76·8% (20 475 of 26,658 patients) after 12 months, 70·8% (18,306 of 25,849 patients) after 24 months, and 69·7% (17,787 of 25,535 patients) after 36 months. Patient-level data included 29,145 patients. 14,630 (50·2%) began treatment under option B+. Patients in option B+ had a higher risk of having no follow-up and, for the first 2 years of ART, higher risk of loss to follow-up than did patients who started ART because they had CD4 counts less than 350 cells per µL or WHO clinical stage 3 or 4 disease. Risk of loss to follow-up during the third year was low and similar for patients retained for 2 years. Retention rates did not change as the option B+ programme matured. INTERPRETATION: Our data suggest that pregnant and breastfeeding women who start ART immediately after they are diagnosed with HIV can be retained on ART through the option B+ programme, even after many have stopped breastfeeding. Interventions might be needed to improve retention in the first year on ART in option B+. FUNDING: Bill & Melinda Gates Foundation, Partnerships for Enhanced Engagement in Research Health, and National Institute of Allergy and Infectious Diseases.

Barriers to using eHealth data for clinical performance feedback in Malawi: A case study.

INTRODUCTION: Sub-optimal performance of healthcare providers in low-income countries is a critical and persistent global problem. The use of electronic health information technology (eHealth) in these settings is creating large-scale opportunities to automate performance measurement and provision of feedback to individual healthcare providers, to support clinical learning and behavior change. An electronic medical record system (EMR) deployed in 66 antiretroviral therapy clinics in Malawi collects data that supervisors use to provide quarterly, clinic-level performance feedback. Understanding barriers to provision of eHealth-based performance feedback for individual healthcare providers in this setting could present a relatively low-cost opportunity to significantly improve the quality of care. OBJECTIVE: The aims of this study were to identify and describe barriers to using EMR data for individualized audit and feedback for healthcare providers in Malawi and to consider how to design technology to overcome these barriers. METHODS: We conducted a qualitative study using interviews, observations, and informant feedback in eight public hospitals in Malawi where an EMR system is used. We interviewed 32 healthcare providers and conducted seven hours of observation of system use. RESULTS: We identified four key barriers to the use of EMR data for clinical performance feedback: provider rotations, disruptions to care processes, user acceptance of eHealth, and performance indicator lifespan. Each of these factors varied across sites and affected the quality of EMR data that could be used for the purpose of generating performance feedback for individual healthcare providers. CONCLUSION: Using routinely collected eHealth data to generate individualized performance feedback shows potential at large-scale for improving clinical performance in low-resource settings. However, technology used for this purpose must accommodate ongoing changes in barriers to eHealth data use. Understanding the clinical setting as a complex adaptive system (CAS) may enable designers of technology to effectively model change processes to mitigate these barriers.

Informatics solutions for bridging the gap between clinical and laboratory services in a low-resource setting.

Background: There has been little formal analysis of laboratory systems in resource-limited settings, despite widespread consensus around the importance of a strong laboratory infrastructure. Objectives: This study details the informational challenges faced by the laboratory at Kamuzu Central Hospital, a tertiary health facility in Malawi; and proposes ways in which informatics can bolster the efficiency and role of low-resource laboratory systems. Methods: We evaluated previously-collected data on three different aspects of laboratory use. A four-week quality audit of laboratory test orders quantified challenges associated with collecting viable specimens for testing. Data on tests run by the laboratory over a one-year period described the magnitude of the demand for laboratory services. Descriptive information about the laboratory workflow identified informational process breakdowns in the pre-analytical and post-analytical phases and was paired with a 24-hour sample of laboratory data on results reporting. Results: The laboratory conducted 242 242 tests over a 12-month period. The four-week quality audit identified 54% of samples as untestable. Prohibitive paperwork errors were identified in 16% of samples. Laboratory service workflows indicated a potential process breakdown in sample transport and results reporting resulting from the lack of assignment of these tasks to any specific employee cadre. The study of result reporting time showed a mean of almost six hours, with significant variation. Conclusions: This analysis identified challenges in each phase of laboratory testing. Informatics could improve the management of this information by streamlining test ordering and the communication of test orders to the laboratory and results back to the ordering physician.

Applying lessons learnt from the 'DOTS' Tuberculosis Model to monitoring and evaluating persons with diabetes mellitus in Blantyre, Malawi.

The global burden of diabetes mellitus (DM) is immense and predicted to reach 438 million by 2030, with 80% of the cases being in the developing world. The management of chronic non-communicable diseases like DM is poor in most resource-limited settings, and the 'directly observed therapy, short course' (DOTS) framework for tuberculosis control has been proposed as a feasible way to improve this situation. In late 2009, aspects of the DOTS model were applied to the management of persons with DM in the diabetes clinic in Queen Elizabeth Central Hospital, Blantyre, Malawi, and a point-of-care electronic medical record system was set up to support and monitor patients in care. This is the first quarterly and cumulative report of persons with DM registered for care stratified by treatment outcomes, complications and medication history up to 31 December 2010. There were 170 new patients registered between October and December 2010, with 1864 ever registered by 31 December 2010. Most patients were alive and in care; 3 died, 53 defaulted and 3 transferred out. Of those on oral hypoglycaemic agents, metformin was most commonly used. Complications were common. The monitoring and evaluation will be further refined, and at the same time, the systems developed in Blantyre will be expanded to other parts of the country.

The feasibility of automating audit and feedback for ART guideline adherence in Malawi.

OBJECTIVE: To determine the feasibility of using electronic medical record (EMR) data to provide audit and feedback of antiretroviral therapy (ART) clinical guideline adherence to healthcare workers (HCWs) in Malawi. MATERIALS AND METHODS: We evaluated recommendations from Malawi's ART guidelines using GuideLine Implementability Appraisal criteria. Recommendations that passed selected criteria were converted into ratio-based performance measures. We queried representative EMR data to determine the feasibility of generating feedback for each performance measure, summed clinical encounters representing each performance measure's denominator, and then measured the distribution of encounter frequency for individual HCWs across nurse and clinical officer groups. RESULTS: We analyzed 423,831 encounters in the EMR data and generated automated feedback for 21 recommendations (12%) from Malawi's ART guidelines. We identified 11 nurse recommendations and eight clinical officer recommendations. Individual nurses and clinical officers had an average of 45 and 59 encounters per month, per recommendation, respectively. Another 37 recommendations (21%) would support audit and feedback if additional routine EMR data are captured and temporal constraints are modeled. DISCUSSION: It appears feasible to implement automated guideline adherence feedback that could potentially improve HCW performance and supervision. Feedback reports may support workplace learning by increasing HCWs' opportunities to reflect on their performance. CONCLUSION: A moderate number of recommendations from Malawi's ART guidelines can be used to generate automated guideline adherence feedback using existing EMR data. Further study is needed to determine the receptivity of HCWs to peer comparison feedback and barriers to implementation of automated audit and feedback in low-resource settings.